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Abstract — In this paper, we derive outer bounds on the capacity 
region of two classes of the general two-user discrete memoryless 
' broadcast channels with side-information at the transmitter. The 
] first class comprises the classical broadcast channel where a 
sender transmits two independent messages to two receivers. 
■ A constraint that each message must be kept confidential from 
' the unintended receiver constitutes the second class. For both 
classes, the conditional distribution characterizing the channel 
depends on a state process and the encoder has side-information 
provided to it in a noncausal manner. For the first class of 
channels, an outer bound is derived employing techniques used to 
prove the converse theorem for the Gel'fand-Pinsker's channel 
with random parameters; the bounds are tight for individual 
rate constraints, but can be improved upon for the sum rate. 
The technique for deriving outer bounds for the second class 
of channels hinges on the confidentiality requirements; we also 
derive a genie-aided outer bound, where a hypothetical genie 
gives the unintended message to a receiver which treats it 
as side-information during equivocation computation. For both 
classes of channels, Csiszar's sum identity plays a central role in 
establishing the capacity outer bounds. 

I I. Introduction 

An information-theoretic study of broadcast channels (BC) 
' was first initiated by Cover in Q. In the classical setting, the 
BC comprises a sender who wishes to transmit k independent 
messages to k noncooperative receivers. The largest known 
, inner bound on the capacity region when k — 2 has been 
derived by Marton ||2l, while outer bounds for this scenario 
have appeared in Q, (Q. Several variants of this classical 
setting have also received considerable attention. One of the 
most prominent variants is BC with side-information, where 
the conditional probability distribution characterizing the chan- 
nel depends on a state process, and where the channel side- 
information is available at the transmitter or at the receiver 
or at both ends. Capacity inner bounds for the two-user BC 
with noncausal side-information at the transmitter have been 
derived by Steinberg and Shamai in |5|, where Marton's 
achievability scheme has been extended to state dependent 
channels. In ||6|, inner and outer bounds are derived for the 
degraded BC with noncausal side-information at the trans- 
mitter; the capacity region is derived when side-information 
is provided to the encoder in a causal manner The capacity 
region for BC with receiver side-information is derived in 17J, 



where a genie provides each receiver with the message that it 
need not decode. 

In a wireless network paradigm, the issue of information 
security has attracted concerns mainly due to the broadcast 
nature of the wireless medium. In the information theory 
literature, capacity results/bounds have been derived for both 
point-to-point and several multiuser networks with secu- 
rity/confidentiality constraints. For BC with confidential mes- 
sages, Csiszar and Korner derived capacity bounds for the two- 
user scenario |[8l, where the sender transmits a private message 
to receiver 1 and a common message to both receivers, while 
keeping the private message confidential from receiver 2. 
Capacity bounds have been derived in ||9l for broadcasting 
two independent messages to two receivers, by keeping each 
message confidential from the unintended receiver See ifTOll 
for an exhaustive coverage of papers in this area of research. 

A. Our contribution 

In this paper, we derive outer bounds on the capacity region 
of the two-user discrete memoryless BC with 

1) noncausal side-information at the transmitter This con- 
stitutes BC of Class I. An inner bound for this class of 
BC was derived in f5l|. 

2) noncausal side-information at the transmitter and confi- 
dentiality constraints, where two independent messages 
are transmitted to two receivers such that each message 
must be kept confidential from the unintended receiver 
This constitutes BC of Class II. An inner bound for this 
setting has been derived by the authors in [ 1 1 j . 

For channels of Class I, we employ techniques used to prove 
the converse theorem for the Gel'fand-Pinsker's channel with 
random parameters fl2\, while for channels of Class II, 
confidentiality constraints are utilized to derive outer bounds. 
A genie-aided outer bound is also derived for channels of 
Class II. For both classes of channels, Csiszar's sum identity 
|fT3l plays a central role in establishing the capacity outer 
bounds. The remainder of the paper is organized as follows. 
In Section [III we introduce the notation used and provide a 
mathematical model for the discrete memoryless version of the 
channels considered in this paper. In Section |III1 we describe 
an outer bound to the capacity region of the two classes of 



channels and suggest a tighter outer bound for the sum rate of 
Class II channels. We conclude the paper in Section |IVl The 
proofs of the theorems are relegated to appendices. 

II. Channel Model & Notation 

We denote the channel model by Ci;i — 1,2 is the 
model index. Calligraphic letters are used to denote finite 
sets, with a probability function defined on them. Uppercase 
letters denote random variables (RV), while boldface upper- 
case letters denote a sequence of RVs. Lowercase letters are 
used to denote particular realizations of RVs, and boldface 
lowercase letters denote N— length vectors. N is the number 
of channel uses and rt = 1, . . . , N denotes the channel index. 
The sender is denoted S and the receivers are denoted Di; 
t = 1,2 is the receiver index. Discrete random variables 
(RV) defined on finite sets X ^ X and Yt G denote 
the channel input and outputs, respectively. The encoder of S 
is supplied with side-information w £ W^, in a noncausal 
manner The channel is assumed to be memoryless and is 
characterized by the conditional distribution p{yi , y2 |x, w) = 
Yln=iP(yi,n:y2,n\xn,Wn). During proofs of outcr bounds, 
the following notation will be useful for sequences of 
RVs: Consider Yi = (Yi.i, • . • , Yi.n)- Then, Y^'^^ ^ 
(Fi,!, . . . , and YN„^^ 4 (r, „_^i, . . . , Yi^^)- 

To transmit its messages, S generates two RVs Mt G Ait, 
where Mt = {!,■•■, 2^^^'} denotes a set of message indices. 
Without loss of generality, 2^^' is assumed to be an integer, 
with Rt being the transmission rate intended to Dt- Mt denotes 
the message, S intends to transmit to Df, and is assumed to 
be independently generated and uniformly distributed over the 
finite set Mt. Integer nit is a particular realization of Mt and 
denotes the message-index. 

For the channel Ci, a ((2'^'"i , 2^-^^), N, Pi'^^) code com- 
prises: 

1) N encoding functions /, such that x = f (toi, TO2, w), 

2) Two decoders - gt : ^ Mt- 

For the channel C2, a {{2^^\2^^^),N,p!:^'^) code com- 
prises: 

1) A stochastic encoder, which is defined by the matrix 
of conditional probabilities (/)(x|mi, 7712, w), such that 
X]x</'(x|m-i,TO2,w) = 1. Here, (/)(x|toi, m2, w) de- 
notes the probability that a pair of message-indices 
(mi, 7712) is encoded as x G to be transmitted by 
S, in the presence of noncausal side-information w. 

2) Two decoders - gt : ^ Mt- 

The average probability of decoding error for the code, 
averaged over all codes, is pI^\ — maxjPg'^'', P^f^^}, with, 

=E E ^i^[^Pr[5*(3^r)^-t|m,wsent], 

where m = (mi, 7712). A rate pair (i?i.i?2) is said to be 
achievable for the channel Ci, if there exists a sequence of 
((2Nfli ^ 2N«2) pWj ^Qjjgg^ V(5 > and sufficiendy small, 

such that P^J^ < (5 as N — > 00. Since the channel C2 



has confidentiality requirements, (i?i,i?2) must also satisfy 
the following weak-secrecy constraints lfT4l to be considered 
achievable for the channel C2: 

NRi-H{Mi\Y2)<Nd, (1) 
Ni?2 -H{M2\Yi) < N5, (2) 

where iJ(x|y) is the conditional entropy of x given y. For 
both channels, the capacity region is defined as the closure of 
the set of all achievable rate pairs {Ri, i?2)- 

III. Main Results 

A. Class !.• Broadcast channels with side -information 

For the channel Ci, we consider the set Vi of all joint prob- 
ability distributions pi{w,vi,V2,x,yi,y2) that is constrained 
to factor as follows: 

Pi{w,vi,V2,x,yi,y2) ^ p{w)p{vi , W2 1 w) 
xp{x\w,vi,V2)p{yi,y2\x)- 

For a given pi{.) G Pi, an outer bound for Ci is described 
by the set TZi^omiPi), which is defined as the union of all rate 
pairs (i?i,i?2) that simultaneously satisfy jS]) - (|5]). 



Ri < I{VuYi)-I{W;Vi), (3) 

i?2 < I{V2;Y2)-I{W;V2), (4) 
R1+R2 < I{Vi;Yi) + I{V2;Y2) 

-I{W;Vi) - IiW-V2). (5) 



Theorem 3.1: Let Ci denote the capacity region of the 
channel Ci. Let 7^l,out = Upi(.)G-Pi ^i:0"t(Pi)- ^he region 
^i,out is an outer bound for Ci, i.e., Ci C 7?,i_out- 
The proof of Theorem 13.11 can be found in Appendix |A] 

B. Class II.- Broadcast channels with side-information & con- 
fidential messages 

For the channel C2, we consider the set P2 of all joint 
probability distributions p2{w,u,Vi,V2,x,yi,y2) that is con- 
strained to factor as follows: 

P2iw, U, Vi ,V2,X, 2/1, ^2) = p{w)p{u)p{vi , V2\'W, u) 

xp{x\w,vi,v2)p{yi,y2\x). 

For a given P2{ ) G P2, an outer bound for C2 is described by 
the set 7^2,out(p2), which is defined as the union over all dis- 
tributions P2{-) of all rate pairs (_Ri,i?2) that simultaneously 



satisfy © - dH). 

Ri < min[/i,/*], (6) 

R2 < min[/2,/2*], (7) 

R1+R2 < min[/i2,/r2], (8) 



where /i, . . . ,/i2 are given by (|9]) - ([T4|, respectively. Note 
that, Ii, I2 and 1*2 are genie-aided outer bounds, where a 
genie gives Di message M2, while D2 computes the equivo- 
cation using M2 as side-information. The auxiliary RVs U, V\ 
and V2 are constrained to satisfy the following Markov chains: 



Ri < IiV,;Y,\U)-I{V,;Y^\U)+HiW\U,V,)^h, (9) 
i?2 < I{V2;Y2\U)~I{V2;Yi\U) + H{W\U,V2)=l2, (10) 
i?2 < I{Vi;Yi\U) + I{V2;Y2\U)-IiVi;Y2\U)-I{V2;Yi\U) + H{W\U,Vi) + H{W\U,V2) = Ii2. (11) 



i?i < IiVi;Yi\U,V2)~IiVi;Y2\U,V2) + HiW\U,Vi,V2) 
R2 < I{V2;Y2\U,Vi)-I{V2;Yi\U,Vi) + H{W\U,Vi,V2) 
R2 < I{Vi;Yi\U,V2)+I{V2;Y2\U,Vi)~I{Vi;Y2\U,V2)- 



= (12) 
^1*2, (13) 
I{V2;Yi\U,Vi) + 2H{W\U,Vi,V2) ^ 112- (14) 



Theorem 3.2: Let C2 denote the capacity region of the 
channel C2. Let 7^2,out = Up2(.)e-P2 ''^2,out(P2)- The region 
"7^2, out is an outer bound for C2, i.e., C2 ^ 7?.2.out. 
The proof of Theorem |3.2| can be found in Appendices iBl and 

o 

C. Inner bounds for Class I & Class II channels 

For a given pi{.) G Vi, a lower bound on the capacity 
region for Ci is described by the set TZi,in{pi), which is 
defined as the union over all distributions pi{.) of the convex- 
hull of the set of all rate pairs {Ri,R2) that simultaneously 
satisfy (fTSj) - (fT7|) . It was first characterized by Steinberg and 
Shamai ^5, Theorem 1]. 

Ri < I{Vi;Yi) - I{W;Vi), (15) 

R2 < I{V2;Y2) - I{W;V2), (16) 
R1+R2 < I{Vi;Yi)+I(V2;Y2) 

-I{Vi;V2) - I{Vi,V2;W). (17) 

Comparing Q - © with ([T5|) - ([17]), we see that the outer 
bounds are tight for the individual rate constraints, Ri and 
i?2. However, the bound on i?i + R2 can be improved upon. 

For a given P2{-) & V2, an inner bound on the capacity 
region for C2 is described by the set TZ2,m{p2), which is 
defined as the union over all distributions P2{-) of the convex- 
hull of the set of all rate pairs (i?i,i?2) that simultaneously 
satisfy ^ - (|20|. For proof, see |11, Theorem 3.1]. 

Ri < IiVi;Yi\U) 

- max[I{Vi;Y2\U, V2), I{W; Vi\U)],{l^) 

R2 < I{V2\Y2\U) 

- max[/(F2; Fi), I{W; V2\U)],{\9) 
R1+R2 < I{Vi;Yi\U) + I{V2;Y2\U) 

-I{Vi;Y2\U,V2) - I{V2;Yi\U,Vi) 
~I{Vi;V2\U)-I{Vi,V2;W\U). (20) 

D. A tighter bound on Ri + R2 for Class II channels 

For the channel C2, the outer bound on i?i + R2 can be 
made tighter by following a simple procedure. From (|9]) - (fTTT) . 
we see that + i?2 < + ^2, and from ([T2| - ([T4| we have 
i?i + i?2 < It + l2- Therefore, 

Ri+R2< min[/i + /* , h + Ii] ■ (21) 



We show now that the bound (j2ip is tighter than (fTT]) and 
([T4|. It is easy to see that 

h + l2 = 1*1 + 1*2 + I{W; Vi\U, V2) + I{W; V2\U, Vi). 
Consider 

2(/i + /2) = 2[/* + /* + I{W; Vi\U,V2)+ I{W; V2\U, Vi)], 

which implies the following: 

min[/i +/*,/2+/r] < /1+/2, 
min[/i +/*,/2+/i*] < I^+i;. 

Therefore, the sum rate bound given by (1211 is tighter than 
dll]) and 

IV. Conclusions 

We derived capacity outer bounds for two classes of broad- 
cast channels. Class I channels comprised two-user BC with 
side-information provided to the transmitter in a noncausal 
manner For this class of channels, an outer bound is derived 
employing techniques used to derive the converse theorem 
for Gel'fand-Pinsker's channels with random parameters. We 
showed that the bounds are tight for individual rate con- 
straints, but the bound on the sum rate can be improved 
upon. BC with noncausal side-information at the transmitter 
and confidentiality constraints, where each message is kept 
confidential from the unintended receiver, constituted channels 
of Class II. For this class of channels, we derived two types 
of outer bounds; the genie-aided outer bound is derived by 
letting a hypothetical genie give the unintended message to 
a receiver, while that receiver computes equivocation treating 
the unintended message as side-information. 

Appendix A 

Here, we prove Theorem 13. II Ve > and sufficiently small; 
and for large N, Ri can be bounded as follows: 

Ni?i = iJ(Mi) = /(Mi; Yf ) + H{Mi\Y^) 

< /(Mi;Yf)+Ne 

N 

Tl=l 

(-) 

< ^[i/(ri,„)-i/(yi,„|Yr\Afi)]+Ne 

n=l 



^/(A/i,Yri;yi,„)+Ne 



id) 



n=l 
N 



5][/(Mi,Yr\W^::+i;yi,„) 

n=l 

-/(WN^i;yi,„|Mi,Yri)]+Ne 

N 

5][/(Mi,Yr\W^+i;yi,„) 

n=l 

-/(Yri;t¥„|Mi,W^:^+i)]+Ne 

N 

5][/(Mi,Yr\W^+i;yi,„) 

n=l 

-/(Mi,WN^i,Yri;l^„)]+Ne, 

where (a) follows from Fano's inequality |15|, (b) follows 
from chain rule, (c) follows from the fact that conditioning 
reduces entropy, (d) follows from Csiszar's sum identity and 
(e) is due to the fact that (A/i, W^_^]^) is independent of Wn- 
Letting Vun = (A/i,WN^i,Yr'), we get 

N 

Ni?i < li^hn, Yhn) - I{Vi,n; W„) + Ne. (22) 



n=l 

-/(Mi;r2,„|YN„^i,Yri)]+2Ne 



< ^[/(Mi,W^„;Yi,„|YL+i,Yri) 



Proceeding in a similar manner and letting V2.n 
(A/2, Y2"^), we get the following bound on R2: 



N 



Ni?2 < J2 ^(^2,n; r2,„) - I{V2,n; Wn) + Ne. (23) 

n=l 

A bound on the sum rate i?i + i?2 is obtained by using the 
fact that Ml and A/2 are independent and following the same 
procedure used to bound Ri and /?2, to get 

N 

N(/?l +R2)<Y, [I{yi,n;Yi^n) + /(^2,„; Y2,n) 
n=l 

-I{Vl,n]Wn) - I{V2,n]Wn)] 

+2Ne. (24) 

Appendix B 



Here, we prove Theorem 13. 21 Ve > and sufficiently small; 
and for large N, Ri can be bounded as follows: 

N/?i = //(A/i) = /(A/i; Yf ) + H{Mi\Y^) 

< /(A/i;Yf)+Ne 

< /(A/i;Yf)-/(A/i;YN) + 2Ne 

N 

= ^[/(A/i;ri,„|YN„+i) - W;>^2.„|Yri)] 

n=l 

+2Ne 



5][/(A/i,Y2"-^ri,„|YN„^i) 

n=l 

-/(A/i,YN„+i;r2,„|Yri)]+2Ne 



-/(A/i;r2,„|Yr,„+i,Yr^)]+2Ne 

N 

5][/(A/i;ri,„|Yj^„+i,Y«-i) 

n=l 

+/(W^„;ri.,|A/i,Y^^„+i,Yri) 
-/(A/i;r2,„|YN„+i,Yr')]+2Ne 

N 

^[/(A/i;ri,„|Yj^„+„Y«-i) 

n=l 

+//(W^„|A/i,Y^^„+i,Yri) 
-//(W^„|A/i,ri,„,Y^|„^.i,Yri) 
-/(A/i;y2.n|YL+i,Y: 



+i,Y2"-i)]+2Ne 



< ^[/(A//i;ri,„|YL+i,Yri) 

n=l 

+H(Ty„|A/i,Y^^„+i,Y2"-i) 

1+ 



/(A/i;y2,n|Y^^„+i,Y2"-i)] + 2Ne, 



where (a) is from Fano's inequality, (6) is from confidentiality 
constraints, (c) and (d) follow from Csiszar's sum identity and 
(e) is the chain rule for mutual information. Letting C/„ ~ 
(YN„^^, Y^') and 1/1,1 = ... = ■^^i.N = Ml we get 



N/?i < ^[/(l/i,„;ri,„|C/„) + /f(W^„|C/„,l/i,„) 



n=l 



-/(14,«;>'2,«|C/„)]+2Ne. 

Proceeding in a similar fashion and letting ¥2,1 = 
V2 N = M2, R2 can be bounded as follows: 



N/?2 < Y.^I{V2.n;Y2^n\Un)+H{Wn\Un,V2.^ 
n=l 



(25) 



-I{V2.n;Yi,n\Un)]+2Ne. 



(26) 



A bound on the sum rate Ri + R2 is obtained by using the 
fact that A/i and A/2 are independent and following the same 
procedure used to bound Ri and /?2. 

N 

N(/?l +/?2) < J2^I{Vi,n;Yi,n\Un) + I{V2,n-Y2,n\Un) 
n=l 

-I{Vl,n;Y2,n\Un)]-I{V2.n:Yi,n\Un) 
+ H{Wn\Un, Vl,„) + H{Wn\Un, V2^n) + 4Ne. (27) 

Appendix C 

For the channel C2, consider a hypothetical genie which 
gives Di message A/2, while D2 computes the equivocation 



using M2 as side-information. Ve > and sufficiently small; 
and for large N, Ri can be upper bounded as follows: 

Ni?i = H{Mi) < H{Mi\Y^) + Ne 

< i?(Mi,M2|YN) + Ne 

= ff(Mi|Y^,M2) + i/(M2|Y2^)+Ne 

< H{Mi\Y^,M2) + Ne 

< H{Mi\Y^,M2)- H{Mi\Yf )+Ne 

(a) 

< i/(Afi|Y^, Af2) - H{Mi\Yf,M2) + Ne 

< I {Ml ; Yf IM2) - I{Mi ; Y^ jMs) + 2Ne 



Similarly, 



= ^[/(Mi;yi,„|Y^|„+i,M2) 



n=l 



-/(Mi;>2,„|Yr\A^2)] + 2Ne 



(6) 



y ^[/(Mi,Yr\yi,„|Y^|„+i,M2) 



n=l 



-/(Ml, YN„^^;y2_„|Yr\M2)] + 2Ne 



y ^[/(Mi;ri,„|Y^|„+i,Yr\M2) 



n=l 



-/(Mi;y2,„|Yf,„+i,Yr\M2)] +2Ne 

N 

< ^ [/(Ml , iy„ ; Fi^n I Y^^„+i , Yr 1, M2) 



n=l 



-/(Mi;y2,n|Yf^„+i, Yr\M2)] + 2Ne 

N 

= ^[/(Mi;yi,„|Yj^„+i,Yr\M2) 



-/(T4/„ ; ri,„ I Ml , Yf^„+i , Yr \ M2) 

1+1 



-/(Ml ; r2,n I Y^^„+i , Y^-\ M2)] + 2Ne 



= 5][/(Mi;yi,„|Y^^„+i,Yr\M2) 

n=l 

+//(H^„|Mi,Y^|„+i,Yr\M2) 
-/f(M^„|Mi,yi,„,YN„+i,Yr\M2) 
-/(Mi; r2,„|Y^|„+i, Yr 1, M2)] + 2Ne 

N 

< ^[/(Mi;ri,„|Y^^„+i,Yri,M2) 

n=l 

+/r(iy„|Mi,YN„_^i,Yr\M2) 
-/(Mi; F2,„|Y^^„+i, Yr \ M2)] -f 2Ne, 

where (a) follows since the genie gives Di message A/2, 
(6) and (c) follow from Csiszar's sum identity. Letting 

Un = (YN„+i,Y^^-1), ^1,1 = ••• = l/i,N = A/i and 
V2.1 = • • • = V2,N = M2, Ri can be bounded as 

N 

N/?l < J2i^{Vi^n;Yi^n\Un,V2,n) 
n=l 

-f2Ne. (28) 



N/?2 < Y.^I{V2,n;Y2,n\Un,Vi,n) 



+/f (w„|?7„, i/i,„, y2,„) - /(i^2,„; n,„|c/„, i/i,„)] 

-f2Ne. 



(29) 



To bound the sum rate, we use the fact that M\ and M2 are 
independent to get 

N 

N(i?i + i?2) < 5I[^C^'i,";^i,"lt^"'V2,„) 

n=l 

+/("l^2,„; l'2,„|C/n, Vl,n) - I (Vun, Y2,n\Un, 1^2,„) 
-I{V2,n; yi,„|C/„, Vi^n) + 2H{Wn\Un, Fl^n, 1^2,«) 

+4Ne. (30) 

Finally, a time sharing RV Q, which is uniformly distributed 
over N symbols and independent of all the RVs is introduced 
for the single letter characterization of the above derived outer 
bounds. Applying the procedure similar to the one presented 
in ESI Chapter 15.3.4] on ^ - (|25|l - (|27ll and (|28|) - 
((30)) . we get the outer bounds Q - (|5|) and jS]) - dS]). 
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